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Abstract 



This paper considers the i-T-user cognitive interference channel with one primary and K — 1 
secondary/cognitive transmitters with a cumulative message sharing structure, i.e., cognitive transmitter 
i € [2 : K] knows non-causally all messages of the users with index less than i. We propose a computable 
outer bound valid for any memoryless channel. We first evaluate the sum-rate outer bound for the high- 
SNR linear deterministic approximation of the Gaussian noise channel. This is shown to be capacity for 
the 3-user channel with arbitrary channel gains and the sum-capacity for the symmetric K-user channel. 
Interestingly, for the K user channel having only the K-ih cognitive transmitter know all other messages 
is sufficient to achieve capacity, i.e., cognition at transmitters 2 to K — 1 is not needed. Next, the sum- 
capacity of the symmetric Gaussian noise channel is characterized to within a constant additive and 
multiplicative gap. The proposed achievable scheme for the additive gap is based on Dirty Paper Coding 
and can be thought of as a MIMO-broadcast scheme where only one encoding order is possible due 
to the message sharing structure. As opposed to other multiuser interference channel models, a single 
scheme suffices for both the weak and strong interference regimes. With this scheme, the generalized 
degrees of freedom (gDoF) is shown to be a function of K, in contrast to the non cognitive case and 
the broadcast channel case. Interestingly, it is show that as the number of users grows to infinity the 
gDoF of the if -user cognitive interference channel with cumulative message sharing tends to the gDoF 
of a broadcast channel with a if-antenna transmitter and K single-antenna receivers. The analytical 
additive additive and multiplicative gaps are a function of the number of users. Numerical evaluations 
of inner and outer bounds show that the actual gap is less than the analytical one. 
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Index Terms 

Cognitive Interference Channel; Generalized Degrees-of-Freedom; Dirty-Paper Coding; Sum-capacity; 
Linear Deterministic Channel; Symmetric Gaussian Channel; MIMO Broadcast Channel; Multiplicative 
Gap; Additive Gap. 

I. Introduction 

One of the many promising uses of the recently emerged cognitive radio technology has been 
to enhancing spectral management by allowing artificially intelligent secondary users (cognitive 
radios) to exploit the same frequency band without significantly degrading the performance of 
licensed/primary users. Cognitive radios are capable of searching for available unused spectrum 
(interweave), they can operate simultaneously with primary users as long as the interference 
caused is within an acceptable level (underlay), or it can exploit knowledge of the messages of 
primary users through encoding schemes to cancel interference (overlay) [[TJ. 

The cognitive radio channel, first introduced in [|2j, falls into the overlay category, and consists 
of two source-destination pairs in which one of the transmitters called the secondary transmitter 
has non-causal a priori knowledge of the message of the other transmitter known as the primary 
transmitter. This non-causal message knowledge idealizes a cognitive radio's ability to overhear 
other transmissions and exploit them to either cancel them out at their own receiver or aid in their 
transmission. For the state-of-the-art on the two-user cognitive channel we refer the reader to p|, 
Q. In particular, the capacity of the semi-deterministic two-user cognitive channel is known [3|; 
the capacity of the Gaussian noise channel is known exactly for most channel parameters, and 
to within one bit otherwise Q. 

In this paper we extend the two-user cognitive interference channel to the case of K users. 
The i\~-user cognitive interference channel analyzed in this work consists of one primary and 
K — 1 secondary, or cognitive, users. We assume a cumulative message cognition structure 
introduced in (5J for the three-user channel, and extended here to K users, whereby user 1 
is the primary user, and cognitive users i, i E [2 : K\, know the messages of user 1 through 
i — 1. The cumulative message cognition model is inspired by the concept of overlaying, or 
layering, cognitive networks. In particular, we consider multiple types of devices sharing the 
spectrum. The first "layer" consists of the primary users. Each additional cognitive layer transmits 
simultaneously with the previous layers (overlay) given the lower layers' codebooks. This may 
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enable them to learn the lower layers' messages and use this to aid the lower layers' transmission, 
or to combat interference at their own receivers. For this model, we are interested in the impact 
the cumulative message cognition has on the sum-capacity, or network throughput, and how 
it extends known results for the two-user case (4j. We are also interested in how cumulative 
message cognition differs from K-user channel models such as the K-user interference channel 
(with no cognition) or the i^-antenna broadcast channel (where every user knows all messages). 

A. Past Work 

The literature on the fundamental performance of multi-user cognitive interference channels 
is limited, in part due to the fact that the two-user counterpart is not yet fully understood O), 
|4j. The only other work on a f^-user cognitive interference channel with K > 3 is, to the 
best of our knowledge, that of [[6). In [[6) the channel model consists of one primary user and 
K — 1 parallel cognitive users; each cognitive user only knows the primary message in addition 
to their own message (thus not a cumulative message structure); the cognitive users do not cause 
interfere to one another but only to the primary receiver and are interfered only by the primary 
transmitter (whereas we consider here a fully connected K-user interference channel model); 
for this channel model the capacity in the "very strong" interference regime is obtained by 
using lattice codes [[6). Related as well to i-T-user cognitive channels is the work in [?] where 
the Degrees of Freedom (DoF) of a f^-user interference channel (K independent messages) 
in which each transmitter, in addition to its own message, has access to a subset of the other 
users' messages, is obtained. We will be interested in characterizing the extension of the DoF - 
the Generalized DoF (gDoF), as well as capacity to within a constant gap - for one particular 
message knowledge structure. 

While not much work on K > 3 channels exists, in [|5J, [jV]|— [jTOj different three-user cognitive 
channels are considered; we note that the models differ from the one considered here either in 
the number of transmitter/receivers, or in the message sharing/cognition structure in all but [BJ, 
Q. In the more comprehensive [|7J, several types of 3-user cognitive interference channels are 
proposed: that with "cumulative message sharing" (CMS) as considered here, that with "primary 
message sharing" where the message of the single primary user is known at both cognitive 
transmitters (who do not know each others' messages), and finally "cognitive only message 
sharing" (CoMS) where there are two primary users who do not know each others' message 
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and a single cognitive user which knows both primary messages. Achievable rate regions for 
are obtained which are evaluated in Gaussian noise. The CoMS mechanism yields almost the 
same message structure as in the interference channel with a cognitive relay - identical if the 



relay were to further have a message of its own (see [11|, [12| and references therein for the 
interference channel with a cognitive relay). In [[8j the CoMS was first introduced where an 
achievable rate region was obtained which employs a combination of superposition coding and 
Gel'fand-Pinsker's binning and numerically evaluated for the Gaussian noise channel. In pi the 
CoMS structure is assumed and the cognitive user is furthermore assumed not to interfere with 
the primary users; an inner and an outer bound are obtained. In JTOj capacity under "strong 
interference" for the CoMS is obtained. We thus emphasize that the channel considered here is 
more general than others studied as we consider K users, a fully connected interference channel, 
and consider the less studied CMS sharing structure. 

B. Contributions 

The main contributions of this work are: 

1) We derive a novel and general outer bound region that reduces to the outer bound of p| 
for the two-user case. The bound is valid for any memoryless channel and any number 
of users. The bound does not contain any auxiliary random variables and is therefore 
computable for many channel of interest, including the Gaussian noise channel. 

2) We determine the sum-capacity the 3-user Linear Deterministic Approximation of the 
Gaussian noise channel at high-SNR for any channel parameters. This optimal scheme 
inspires a scheme for the .fT-user symmetric channel. This latter scheme only requires 
cognition of all messages at one transmitter while all the others can be non-cognitive. 

3) We derive the sum-capacity for the symmetric Gaussian Gaussian noise channel with K 
users to within a constant and a multiplicative gap. 

The additive gap is a function of the number of users and grows as (K — 2) \og 2 (K — 2). 
The proposed achievable scheme is based on Dirty Paper Coding and can be thought of as a 
MIMO-broadcast scheme where only one encoding order is possible due to the cumulative 
message sharing mechanism. As opposed to other multiuser interference channel models, 
a single scheme suffices for both the weak and strong interference regimes. Moreover no 
interference alignment of structured coding seems to be needed. Numerical evaluations 
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show that the actual gap is less than the analytical one; this is so because of necessary 
crude bounding steps needed to obtain analytically tractable sum-rate expressions. 
The multiplicative gap is K and is achieved by having all users beamform to the primary 
user. 

4) The normalized gDoF, defined as the pre-log of the sum-capacity as a function of SNR 
normalized by the number of users K, is shown to be a function of K. This is in 
contrast with other interference channel models, like the non-cognitive case or the broadcast 
channel, where the gDoF are the same for any K (except for a discontinuity point). 
Interestingly, it is show that as the number of users grows to infinity the gDoF of the 
.fT-user cognitive interference channel with cumulative message sharing tends to the gDoF 
of a broadcast channel with a i^-antenna transmitter and K single-antenna receivers. 



C. Paper Organization 



The paper is organized as follows. Section [XT] describes channel model. Section III 



contains our 



novel outer bound region; first the 3-user case is considered to highlight the key 'side information' 



idea and then it is extended to any number of users. In Section IV we first derive the sum-capacity 
of the 3-user Linear Deterministic Approximation of the Gaussian noise channel at high-SNR 
for any channel parameters and then extend it to the symmetric fT-user case; we also compare 
the sum-capacity of the interference channel with cumulative message sharing mechanisms with 
other interference channel models. In Section [V] we derive the sum-capacity of the symmetric 
Gaussian noise channel to within an additive and multiplicative gap; we use a DPC-based scheme 
inspired by MIMO-BC with only encoding order possible due to the cumulative message sharing 
mechanism and beamforming to the primary user; we further show by numerical optimization 
of inner and outer bounds that the actual gap is less than the theoretical one. The gDoF is also 
derived and shown to be a function of the number of users; as for other interference models, the 
gDoF and the sum-capacity of the Linear Deterministic Approximation of the Gaussian noise 



channel at high-SNR coincide. Section VI concludes the paper. 
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II. Channel Model 

A. The General Memoryless Channel 

The general memoryless f^-user cognitive interference channel with cumulative message 
sharing (fT-CIFC-CMS) consists of K source-destination pairs sharing the same physical channel 
with some transmitters having non-causal knowledge of the messages of other transmitters. Here 
transmitter 1 is referred to as the primary user and is assumed to have no cognitive abilities. 
Transmitter i, i E [2 : K], is non-causally cognizant of the messages of the users with index 
smaller than i. More formally, the K-CIFC-CMS channel consists of 

• Channel inputs X { E i E [1 : K), 

• Channel outputs Y { 6^, i E [1 : K], 

• A memoryless channel with joint transition probability (or conditional channel distribution) 
P(Y"i, . . . , Y K \Xi, . . . , X K ), 

• Messages Wi which are known to users 1, 2, . . . , i, i E [1 : K\. 

A code with non-negative rate vector . . . , R K ) and blocklength N is defined by 

• Messages Wi, i E [1 : K], uniformly distributed over [1 : 2^^] and independent of 
everything else, 

. Encoding functions rf N) : [1 : 2 NRl ] x . . . x [1 : 2^] Xf such that X? : = 
ri N \w 1 ,...,W l ),tE[l:K}, 

. Decoding functions : [1 : 2^] such that W { = g^iYf), i E [1 : K], 

. Probability of error P e (A ° := max lg[1:A1 F[Wi ^ Wi}. 
The capacity of the K-CIFC-CMS channel consists of all non-negative rate tuples (_R 1; . . . , R K ) 
for which there exist a sequence of codes indexed by the block length iV such that — V 
as iV — > oo. Since the decoders cannot cooperate and the channel is used without feedback, the 
capacity may be shown to depend only on the marginal noise distributions rather than the joint 
noise distribution by an argument similar to that used for the Broadcast Channel (BC) p3| . 

In this work we shall focus on the following two channel models. 
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B. The Gaussian Noise Channel 

The single-antenna complex- valued f^-CIFC-CMS with Additive White Gaussian Noise (AWGN), 
shown in Fig. [T] for the case K = 3, has input-output relationship 

Y e = J2 h a X i + Z ii ^l 1 - K i ( la ) 

ie[l:K] 

where, without loss of generality, the inputs are subject to the power constraint 

E[|X,| 2 ]<1, ie[l:K], (lb) 
and the noises are marginally proper-complex Gaussian random variables with parameters 

Z e ~N(0,l), ie[l: K}. (lc) 

The channel gains hy, G [1 : K] 2 , are constant and therefore known to all terminals. 

Without loss of generality we may assume the direct links ha, i G [1 : K) to be real-valued and 
non-negative since the receiver % can always compensate for the phase of one channel gain. 

The Generalized Degrees-of-Freedom (gDoF) of the symmetric Gaussian channel is a perfor- 
mance metric that characterizes the high-SNR behavior of the sum-capacity and is defined as 
follows. Let SNR be a non-negative number and parameterize 

\h u \ 2 := SNR, z e [1 : K], (2a) 
\h ei \ 2 :=SNR a , (£,i)e[l:K] 2 ,£^i, (2b) 

for some non-negative a. The gDoF is 

d(a) := lim - — ; — , (3) 

V 7 SNR->+oo log(l + SNR) v ' 

where Ce := m&x{Ri + . . . + Rk} and where the maximization is over all achievable rates. The 

sum-capacity is said to be known to within a constant gap of b bits if one can show rates 

and i?£ Ut ^ such that 

4 n) < C E < 4 out) < 4 n) + b log(2). (4) 
The gDoF and constant gap characterization of the symmetric sum capacity imply that 

C s = d(a) log(l + SNR) + o(l), 
where o(l) indicates a quantity that is finite at all SNR. 
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C. Linear Deterministic Approximation of the Gaussian Noise Channel 

The Linear Deterministic approximation of the Gaussian Noise Channel at high SNR (LDC) 
was first introduced in [14] to allow focussing on the signal interactions rather than on the 
additive noise. The proposed framework has been very powerful in revealing key issues for the 
problem of communicating over interfering networks and the insights gained for the LDC have 
often been translated into capacity results to within a constant gap for any finite SNR [j4|, [15|, 



|16|. In light of these success stories we also start our investigation from the LDC. The LDC 



has input-output relationship given by 

Y t = S m -"«X l; £e[l:K], (5) 

where m := max{n» 3 -}, S is the binary shift matrix of dimension m, all inputs and outputs are 
binary column vectors of dimension m, the summation is bit-wise over of the binary field, and 
the channel gains n« for (£,i) G [1 : K] 2 , are positive integers. In a symmetric LDC all direct 
links have the same strength riu = n& > 0,i G [1 : K], and all the interfering links have the 
same strength nu = n.j = a > 0, (£, i) G [1 : K] 2 , £ ^ i. Note that the subscript i (roman 
font) of 72; stands for 'interference' and is not an index; as such it should not be confused with 
index i (italic font). 

The channel in ([5]) can be thought of as the high SNR approximation of the channel in ([TJ) 
with their parameters related as n i3 - = |_l°g(l + l^y| 2 )J> (hj) e [1 : K) 2 - 

III. Outer Bound 

In this section we derive an outer-bound region for the general memoryless K-CIFC-CMS 



as defined in Section II-A We start with the case of K = 3 users to highlight the main proof 



techniques and ease the reader into the extension to any number of users K G N + . 

Theorem 1. The capacity region of the general memoryless 3-CIFC-CMS is contained in the 
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region defined by 

R 1 <I(Y 1 ;X U X 2 ,X 3 ), (6a) 

R 2 <I(Y 2 ;X 2 ,X 3 \X 1 ), (6b) 

R 3 <I(Y 3 ;X 3 \X 1 ,X 2 ), (6c) 

R2 + Rs < I(Y 2 ;X 2 ,X 3 \X 1 ) + I(Y 3 ;X 3 \X 1 ,X 2 ,Y 2 ), (6d) 
R 1 + R 2 + R 3 < 7(y i; Xx, X 2 , X 3 ) + J(y 2 ; X 2 , x 3 |x 1; y) 

+ I(Y 3 ;X 3 \X 1 ,Y 1 ,X 2 ,Y 2 ), (6e) 

/or sowe m/>wf distribution Px 1 ,x 2 ,x- j ,- The joint conditional distribution Py 1 .y 2 ,y- j ,\x 1 ,x 2 ,x 3 can 
be chosen so as to tighten the different bounds as long as the conditional marginal distributions 
PYi\Xi,x 2 ,x 3 , ^ E [1 : 3], are preserved. 

Proof: The proof can be found in Appendix [Aj ■ 
Remarks: 

1) The region in Th. [TJ reduces to the outer bound in [[5} Th. 6] by setting X 3 = Y 3 = 0. 

2) The outer bound region in (|6]) does contain auxiliary random variables. Moreover, every 
mutual information term contains all the inputs. These two facts imply that the outer 
bound region in Th. [T] can be easily evaluated for many channel of interest. For example, 



for the Gaussian noise channel in Section II-B t the "Gaussian maximizes entropy" principle 



suffices to show that jointly Gaussian inputs exhaust the outer bound. 
3) The sum-capacity bound in < [6e| ) is obtained by giving Si as side information to receiver i, 
i E [1 : K], where Si = [Si^Wi-^Y^] starting with S x = 0. With this "nested" side 
information, the mutual information terms can be expressed in terms of entropies which 
may be recombined in ways that can be easily single-letterized. This form of the side 
information allows us to extend the result from the 3-user case to any number of users. 



4) The mutual information terms in ( |6e[ ) have the form 1(1^; X i; . . . , X K \X 1 , Y 1 , . . . , y_i), 
1 < i < K, which can be given the following interpretation. Since message Wi is available 
at transmitters i through K, inputs (Xi, . . . ,X K ) are "informative" for receiver i, while 
inputs (Xi, . . . , Xi_i) are independent of Wf, receiver i decodes from y the informa- 
tion carried in (Xi, . . . ,X K ) that could not be recovered by users with lesser index as 
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represented by (X u Y u . . . , X^, 3^_ x ). 
Th. [T]can be extended to a general memoryless i^-CIFC-CMS. 

Theorem 2. The capacity region of the general memoryless K-CIFC-CMS is contained in the 
region defined by 

Ri < 7(y i; X h . . .,X K \X h . . . ,^_0, ie[l:K\, (7a) 

K K 

^Rj<J2 J (^' X i> ' • • ' XkUi > • • • ' Ki ' • • • ' VO. i € [1 : if], (7b) 



/or 5ome input distribution Px 1 ....,x K - Moreover, each rate bound in f7b| ) ma^ be tightened 
with respect to the channel conditional distribution as long as the channel conditional marginal 
distributions are preserved. 

Proof: The proof is found in Appendix |Bj ■ 
In the following section we shall derive achievable schemes matching the sum-capacity outer 
bound in Th. [2] for the LDC in and schemes that achieve the sum-capacity outer bound to 
within a constant bounded gap regardless of the channel parameters for the Gaussian channel 
in 0. 

IV. Sum-capacity for the Linear Deterministic Zf-CIFC-CMS 



In Sections IV-A and IV-B we determine the sum-capacity of the LDC with K = 3 users and 



any value of the channel gains. In Sections IV-D and IV-E we derive the sum-capacity for any 



K but for symmetric channel gains only. The main results of this section are 



Theorem 3. The sum-capacity bound in ( |6e[ ) is achievable for the LDC 3-CIFC-CMS with 
generic channel gains. 



Theorem 4. The sum-capacity bound in fTb] ) is achievable for the LDC K-CIFC-CMS with 
symmetric channel gains. The capacity achieving scheme only requires cognition of all messages 
at one single transmitter. 

The rest of the section is devoted to their proofs. 
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A. Sum-capacity upper bound for the 3 -user case and generic channel gains 

The sum-capacity outer bound in Th. [T] specialized to a deterministic 3-CIFC-CMS (i.e., 
H(Y i \X 1 , X 2 , X 3 ) — 0, i G [1 : 3]) gives the following sum-capacity upper-bound 

R 1 + R 2 + R 3 < max + H(Y 2 \X h Y x ) + H(Y 3 \X 1: Y h X 2 , F 2 )}, 

where the maximization is over all possible joint distributions Px 1 ,x 2 ,x 3 - 

For the LDC in ^ 

with K = 3 we obtain 

Ri + R 2 + R 3 < max{nn, n 12 , ni 3 } (8a) 
+ f(n 22 ,n 23 \n 12 ,n 13 ) (8b) 
+ [n 33 - max{ni3, n 23 }] + , (8c) 



where f(c, d\a, b) in ( |8b| ) follows from |17l eq.(5)] and is defined as 

{max{c + b, a + d} — max{a, b} if c — d ^ a — b, 
max{a, b, c, d} — max{a, 6} if c — d = a — b. 
The bound in ((8]) follows by maximizing each mutual information term individually as 

H(Y X ) = H{S m - nil X 1 + S m ~ ni2 X 2 + S m - ni3 X 3 ) 

< max{nii,ni2,ni 3 }, 

H(Y 2 \X U Yx) = H(S m - n22 X 2 + S m - n23 X3|X!, S m ~ ni2 X 2 + S m ~ ni3 X 3 ) 

< H(S m - n22 X 2 + S m -" 23 X 3 |S m - ni2 X 2 + S m -" 13 X 3 ) 

< /(n 2 2,n23|ni2,ni 3 ), 

H(Y 3 \X U Y U X 2 , Y 2 ) = H(S m - n33 X 3 \X 1: X 2 , S m ~ n ^X 3 , S m -" 23 X 3 ) 

< [n 33 - max{ni 3 ,n 23 }] + , 

where [x] + := max{0,x}. Notice that i.i.d. Bernoulli(l/2) input bits simultaneously maximize 
each of the above entropy terms. 
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B. Achievability of the sum-capacity upper bound for the 3-user case and generic channel gains 



In the following, depending on whether [71,33 _ max{ni 3 , 77.23}] + in ( j8c| ) is zero or positive, 
different interference scenarios are identified and transmission schemes that are capable of 
achieving the sum-capacity upper bound in ([8]) are proposed. In particular: 

Case 1: If the signal sent by the most cognitive transmitter is received the weakest at the 
intended destination, that is, if 

7733 < max{ni 3 , 77,23}, (9) 

the sum-capacity in ([8]) becomes 

Ri + R 2 + R ?J < max{7in, 7112, 7113} + f(n 22 ,n 23 \n 12 ,n 13 ). 

The condition in (|9]) corresponds to the case H(Y 3 \Xi,Yi, X 2 ,Y 2 ) = 0, i.e., conditioned on 
(Xi,X 2 ) the signal received at the "most cognitive" receiver is a degraded version of the signal 
received at the other two receivers. Recall that user 3 can send information to all receivers as it 
knows all messages. The condition in ([9]) implies that the signal X 3 can convey more information 
to receivers 1 and 2 that it can to the intended receiver 3. In this case, one might thus suspect that 
i?3 = is optimal and that the best use of the cognitive capabilities of user 3 is to "broadcast" 
to the non-intended receivers. We will next show that this is indeed the case. 

We set R 3 = and we therefore convert the LCD 3-CIFC-CMS into a deterministic 2-CIFC- 
CMS where user 1 is the primary user (with input X\ and output Y{) and the cognitive user has 
vector input [X 2 ,X 3 ] and output Y 2 . The capacity of a general deterministic 2-user cognitive 
interference channel is |3] Th. 12] 

R x < H(Y 1 ), R 2 < H(Y 2 \X X ), 
R 1 + R 2 <H(Y 1 )+H(Y 2 \X 1 ,Y l ) 

for some input distribution Px 1 ,[x 2 ,x 3 ]- Hence the sum-capacity is 

Ri + R 2 = max {h{Y x ) + H(y 2 \X x ,Y x )\ 

= max{77n, 77i2, 77i 3 } + /(T722, 77 23 1 7712, 77i3 ), 

which proves our claim. 
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Case 2: In the regime not covered by the condition in ([9]), that is, for 

n 33 > max{n 13 ,n 23 }, (10) 

the sum-capacity in ([8]) becomes 

Ri + R2 + R3 < max{nn,ni 2 ,ni 3 } + f(n 22 , n 23 \n 12 , n 13 ) + n 33 - max{n i3 , n 23 }. 



Is this case, the condition in ( jT0| ) suggests that the intended signal at receiver 3 is sufficiently 
strong to be able to support a non-zero rate. The form of the sum-capacity also suggests that a 
plausible strategy is to use the optimal strategy for Case 1 and "sneak in" extra bits for user 3 
in such a way that they do not appear at the other receivers. We next show that this is optimal. 
We split the signal of transmitter 3 in two parts 

X3 := X 3a + X 3b , 

where X 3a is intended to mimic the scheme for Case 1 (i.e., as if user 2 had input [X 2 , X 3a ]) and 
X 3b carries the information to Y 3 , possibly "pre-coded" against the interference of (Xi, X 2 , X 3a ), 
and such that X 3b is not received at receivers 2 and 3. We define 

X 3b := S max ( n ™> n ^V 3 , 

for some vector V 3 defined in the following. Note that the shift caused by S max ^ ni3 ' ms ^ [ s suc \y 
that V 3 is not received at Yi and at Y 2 . We note that V 3 is "private information" for receiver 3 
that is dirty paper coded against the interference caused by [Xi, X 2 , X 3a ] at receiver 3; with this 
receiver 3 is virtually interference-free. We then implement the optimal strategy for Case 1 with 
[Xi,X 2 ,X 3a ] and with the remaining bits in X 3b we transmit to receiver 3 thereby achieving 
the sum-capacity in @. 

C. Example of sum-capacity optimal schemes for the 3-user case and symmetric channel gains 

We present here some concrete examples of the achievability scheme presented in Sec- 
tion iRMBl 

We consider first the symmetric scenario with n d > 0, n ; = n d a, a > 0. Define the 
normalized sum-capacity as 

max{i?! + R 2 + R 3 } 

dz{a;K) := . 

n d 
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Note that when n d = the channel reduces to a broadcast channel from transmitter [X 2 ,X 3 ] 

to receivers Y\ and Y" 2 (receiver 3 cannot be reached by its transmitter and hence R3 = is 

optimal; similarly the primary user cannot reach its intended destination and cannot deliver 

any information to the other destinations, hence X\ = is optimal); the capacity region of a 

deterministic broadcast channel is known |18j and for the symmetric LDC with n d = it reduces 

to R 1 + R 2 = 2ni. 

When n d > the sum-capacity can be expressed as 

7 / q\ n 1 , f(n d ,n d a;n d a,n d a) + 

dj:{a; 6) = maxjl, a\ H h [1 — a\ 

n d 

3max{l,a} — a for a ^ 1, 
1 for a = 1. 

Fig [2] shows an example of the achievable strategy for weak interference defined as a < 1 



(corresponding to Case 2 in Section IV-A). The case a = 1 corresponds to a channel where all 
received signals are statistically equivalent and therefore its capacity region is as for the 3-user 
Multiple Access Channel. The strong interference regime defined as a > 1 (corresponding to 



Case 1 in Section IV-A ) is not explicitly considered as the achievable strategy is the same as for 
the weak interference regime except for the fact that the most cognitive user does not send any 
message for himself as its bits would create interference at the non-intended receivers. Notice 
the important role of cognition in Fig. [2j The third transmitter (cognitive of all 3 messages) 
sends a linear combination of the messages of users 1 and 2 in such a way that the effect of 
the aggregate interference is neutralized at all receivers. This leaves the receivers of users 1 
and 2 interference-free. The third transmitters also sends some "private" information bits in such 
a way that these bits do not appear at the other receivers. It is important also to observe that 
user 2, who is cognizant of the message of user 1, does not use the knowledge in the encoding 
process. In other words, user 2 need not be cognizant in order to achieve the sum-capacity in 
the symmetric case. 

D. Sum-capacity upper bound for the K-user case and symmetric channel gains 

For the i^-user symmetric LDC the sum-capacity is upper bounded by 

EfcLi R k < J K maxjl, a} -a for a ^ 1, 
I 1 for a = 1, 
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The proof that the sum-capacity upper bound in Th. [2] evaluates to the expression in ( [TTj ) 
is provided next. For the i^-user symmetric LDC with m = 7idmax{l, a} the sum-capacity is 
upper bounded by 



K 



A 



7~] Rk < 2_j ^ (^l^ 1 ' • • ■ ' Xk-x, Yi, ■ ■ ■ , Yk-i) 

k=l 

= J2 H (s m - nd Xk + s m - n; ( x i] \ x i> ■ • • > x *-i> sm_ni ( J2 X * 

k=l \ \i=fc+l / 

+ H(s m - n *X K \X u X K . U S" 1 - 1 '^) 

K-1 

< H^(S m - nd + S m - ni )X k ^ + H(s m - nd X K \S m - ni XK 



k=l k=l 
K-1 



k=l 



< (K — 1) maxjrid, ^i} + [na — ni\ + 
= [K max{ 1 , a] — a 



K 



v i=k 



The discontinuity at a = 1 in ( fTT] ) is because when rid = all received signal are equivalent, 
i.e., Yi = . . . = Y K = 5^i=i an d the channel reduces to a K-user MAC with sum-capacity 
maxif(Yi) = rid- 



E. Achievability of the sum-capacity upper bound for the K-user case and symmetric channel 
gains 

can 



The schemes which were shown to be optimal for LCD 3-CIFC-CMS in Section IV-C 



be extended to any arbitrary number of users. Let Uj j 6 [1 : K], be the signal intended for 
receiver j, that is, Uj is only a function of message Wj, and composed of i.i.d. Bernoulli(l/2) 
bits. Let the transmit signals be 



X K 
so that 



X j = U j , je[l:K-l], 

0?iiX [n d — n\Y 



In-, 



0[n d — xrii 0[ra d — + X [n d — ni' 



K 



[n d — ml^ xrii 



'K-\ 



OniX [n. d — ni] + 
-^[n d -ni] + 



On;Xrii n;X [ri d — nj]" 



[n d — riiJ T xn; 
if 



[n d -n ; _ 



u. 



K ■ 
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where O nxm indicates the all zero matrix of dimension n x m and I n the identity matrix of 
dimension n. With these choices, the signal at receiver £, £ e [1 : K], is 

y e = S m-n dXe + gm-n, ^ ^ 

= (S m " nd + ^ m " ni )X £ , m = max{n d , m}. 

Since the matrix S m ~ nd + S m ~ ni is full rank for n& ^ nu receiver £, £ E [1 : K], decodes Ug from 
(S m ~ nd + S m ~ ni )~ l Yi = X£. Hence receiver £, £ e [1 : K — 1], can decode m = max{nd,ni} 
bits since Xg = Ut, while receiver K can decode the lower [n^ — n ; ] + bits of Uk from X^. 
Interestingly, receivers from 1 to K — 1 are interference free, while receiver K decodes n\ bits 
of the 'interference function' J^f^i 1 Notice that cognition is only needed at one transmitter 
in all interference regimes. This implies that this sum-capacity result holds for all cognitive 
channels where user % is cognizant of any subset (including the empty set) of the messages of 
users with index less than i. 



F. Comparison between different channel models 

We compare the symmetric sum-capacity of channels with different levels of cognition. Our 
base line for comparison is the classical K-user interference channel without any cognition, 



whose sum-capacity is [19] 



d£ FC \a;K) 



K 



a-2) 



(12) 



and where d^ FC \a;2) is the so-called W-curve of [15| except for a discontinuity at a = 1 
where d^ FC \a; K) = 1 for all K [19|. Note that, except at a = 1, the normalized sum-capacity 
j^d^ FC \a; K) does not depend on K. 

At the other end of the spectrum we have the case where all users are cognitive of all messages. 
In this case the channel is equivalent to a MIMO-BC with K transmit antennas and K single- 
antenna receivers. Since the system has enough degrees of freedom to zero-force the interference 
we have 



d^ C \a; K) — K max{l, a}, 



(13) 
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except for a discontinuity at a = 1 where d^ C \a; K) = 1, since in this case all the receivers are 
statistically equivalent and Time Division Multiple Access (TDMA, or time-sharing) is optimal. 
Also in this case, except at a = 1, the normalized sum-capacity ^d^ C \a; K) does not depend 
on K. 



The sum-capacity of the symmetric LDC J^-CIFC-CMS is given by ( fTT| ), which is a function 
of K after normalization by K, i.e., 

1 ,(cifc-cms)/ ~ry~ \ r , -, « /, « A'-l 1 

— A) = max{l,a} - — = max 1 - — , — —a > . (14) 

This has the interesting interpretation that CMS looses a/K with respect to (a; K)/K. In 
other words, as the number of cognitive users increases the CMS sum-capacity approaches the 
sum-capacity of a fully coordinated broadcast channel. 

Fig. [3] shows the sum-capacity normalized by the number of users for different channel models 
(here we do not show the discontinuity at a = 1). We note the increase in performance in all 
interference regimes when compared to that of 2-user CIFC-CMS and the classical K-user 
interference channel, but a loss with respect to the i^-user broadcast channel (BC) with K 
transmit antennas and K single antenna receivers. 

V. Sum-Capacity for Gaussian A-CIFC-CMS to within a constant gap 

In this section we derive the sum-capacity for the symmetric Gaussian channel with an arbitrary 
number of users to within a constant gap. For notational convenience we denote the direct link 
gains as \hd\, which can be taken to be real- valued and non-negative without loss of generality, 
and the interference link gains as h\, so that the channel in ([T]) can be rewritten as 

K 

Y e = (\h d \-h^X £ + h i (j2 X j)+ Z ^ ^[1:K\. 
The main result sof this section are 

Theorem 5. The generalized Degrees-of-Freedom of the symmetric K-user Gaussian noise 
channel are 

d(a) = K max{l, a} — a 

with a discontinuity at a = 1 in the special case where all channel gains are the same (in 
modulo and phase), in which case d(l) = 1. 
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Theorem 6. The sum-capacity bound in (7b) is achievable for the symmetric Gaussian K-CIFC- 
CMS to within 6 bits per channel use for K = 3 and to within (K — 2) \og 2 (K — 2) + 3.88 bits 
per channel use for K > 4. 



Theorem 7. The sum-capacity bound in f7b| ) is achievable to within a factor K by beamforming 
to the primary user. 

A. Sum-capacity upper bound for the K-user case and symmetric channel gains 



J2^k< log (l + (\h d \ + (K- l)|/ii|) 2 ] 
fc=i ^ ' 

+ {K-2) log(2) + {K-2) log (l + 
\h d \ 2 



\h d \ - fn\ 



+ log 1 



l + (K-l)\hi\* 



For the K-user symmetric Gaussian channel with \h d \ ^ h\ the bound in (j7bj) can be further 
bounded as (although we can tighten the bound by choosing the 'worst noise covariance matrix', 
we shall use here independent noises) 

K K 

s y^ J Rk < ^^,l(Xu, ■ ■ ■ , Xk\ Y u Xi, Yi, • • • , X u ~i, Y u -xj 

fc=l u=l 

K 

= l(x x , ■■■ ,X K ; [h^Xt + h i J2x i + Zx) 

i=2 

K-1 K K 

+ J2 J ( X u,--- ,X K -\h A \X u + h Xi + Z u \x e , h^X + Ze, £e[l:u-l] 

u=2 i=u+l i=u 

+ l(x K ) \h d \X K + Z K \x e , hXK + Z e , i G [1 : K - 1]) 

K 

< h^h^ + h^Xi + Z^j -h(Z 1 ) 

i=2 

K-1 

+ J2 ^([M - hi}X u + Z U - Z u - X ) - h{Z u ) 

u=2 

1 A_1 

+ /i(|/i d |X^ + Z K \hiX K + — - Ze) - KZk). 

i=i 

Finally, by the "Gaussian maximizes entropy" principle, we obtain 

K 



(15a) 

(15b) 
(15c) 



January 29, 2013 



DRAFT 



19 



For hi = \h d \ all received signals are statistically equivalent, therefore the K-CIFC-CMS is 
equivalent to a K-user Multiple Access Channel, whose sum-capacity is 

K K 

Rk < . . . , Xk] I /id I /J X% + ^1) 

fc=l i=l 

<\og{l + K 2 \h d \ 2 ). 

In the limit for high SNR and with the channel parameterization as in (|2]), the above upper 
bound can be further bounded 

K 

Y,Rk< \og{K 2 ) + (K - 1) log(2) + (K - 1) log (l + max{|/i d | 2 , |^| 2 }) 
fe=i 



+ log 1 + 



l/i 



d 



i + (^-i)N 2 

to obtain the following gDoF upper bound 

d(a) < — 1) max{l, a} + [1 — a] + = K max{l, a} — a. 

This gDoF remain valid for a = 1 as long as /i; = \h d \ exp(j9) for exp^) 7^ 1; when 
expfj^) = 1 the K-user MAC sum-capacity gives d(a = 1) = 1. This proves the converse part 
of Th. [51 

B. Achievable Rate Region for K-CIFC with CMS 

In this section we describe a scheme which we shall in the Section IV-CI to show that the 



symmetric upper bound derived in Section V-A is achievable to within a constant gap 



Inspired by the capacity achieving strategy for the Gaussian MIMO-BC, we introduce a scheme 
that uses Dirty Paper Coding (DPC) with encoding order 1 — > 2 — > 3 — > ■ ■ • K. We denote by 
Hi the covariance matrix corresponding to the message intended for decoder I, £ e [1 : K], as 
transmitted across the K antennas/transmitters. The overall input covariance matrix is 



A 



£=1 



K 



.£=1 



< 1, k E [1 : K], (16a) 

k,k 

where the constraints on the diagonal elements correspond to the input power constraints. 
Moreover, since message £ can only be broadcasted by transmitters with index larger than £, we 
further impose 

[E e ] k k = for all 1 < k < £ < K. (16b) 
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The achievable rate region is then the set of non-negative rates . . . , R K ) that satisfy 



hlS.h 



Re < log I 1 + — f — N I , hj := [he,ihw . . . h e , K }, £e[l: K], (17) 



for all possible Cov[Xl, . . . , X K ] complying with ( |T6| ), with the convention that Ylk=K+\ = 0. 
In particular we consider the transmit signals 



X j = lj U j + PjUf F) + o^, j e [2 : - 1], 

K-l 

X K = 1kU k -PkY, U j ZF) + a ^ 



3=2 



where U e , Jjf^' are i.i.d. jV(0, e [1 : K], and the coefficients atj,/3j, Jj}je[2-.K] are such 
that 

|ai| 2 < 1, 

l7i| 2 + l/?i| 2 + |ai| a <l, J 6 [2:^-1], 
\ lK \ 2 + \f3 K \ 2 (K-2) + \a K \ 2 <1, 

in order to satisfy the power constraints. Notice the negative sign for /3k, which we shall use 
to implement zero-forcing of the aggregate interference Yl?j=2 Uj^ . Moreover, all transmitters 
cooperate in beam forming U\ to receiver 1. These two facts can be easily seen by observing 
that for p! = ... = p K := P 

K K 



K 



With these choices the message covariance matrices are 
Si = aa^, a := [ai, . . . , olkY ■> 

S j = | 7 / e^ej + \P\ 2 ( ej - e^)(e, - e*)*, j G [2 : K], 

where ej indicates a length-K vector of all zeros except for a one in position j, j E [1 : K], f 
indicates the Hermitian transpose, and where f3 = Pi = . . . = fix- 

We next express the channel vectors for the symmetric Gaussian channel as 

h, = (M - h) *i + ^ \ J2 e k\ > £ E[l : K]. 
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By noticing that 



h / et = ^-j](|/ ld |-^ i ) + /i is £e[l:K], 



where S[k] is the Kronecker's delta function, the following achievable rates are achievable 



i?i = lo£ 



Rj = lo£ 



\hd\ + \h\ J2j=2 a 



1 + \ h i\ 2 J2k=2 It* 



/ 



1 + 



\h d \ - hi 



\P\ 2 + \h d \ 2 \lj\ 2 ^ 



\ 



l + l^l 2 Ef= 7+ il7,| 2 



,je[2:K-2], 



i^ = log(l + |/i d | 2 \ lK \ 2 ) 



(18a) 



(18b) 



(18c) 



where we chose a\ = exp(jZhi) (notice the phase of a,\ which allows coherent combining at 
receiver 1 of the different signals carrying JJ\, i.e., all users beamform to the primary receiver). 



C. Additive Constant Gap Results for the symmetric Gaussian Noise Channel 



We now choose the parameters in ( [18] ) so as to match the upper bound in ( [15] ) 



A tempting interpretation for the bound in ( |15c| ) is to say that the most cognitive user should 
treat all the other signals as noise, because of the term (K — l)|^i| 2 at the denominator of the 
equivalent SNR for receiver K. However we recall that user K is the most cognitive user and 
can therefore 'pre-code' the whole interference seen at its receiver by using DPC; by doing 
so, receiver K would not have anything to treat as noise besides the Gaussian noise itself. We 
therefore interpret the term 1+ ( K \^ h .\2 < 1 as the fraction of power transmitter K dedicates to 
the transmission of its own signal. This amounts to setting 



1 



\lK\ 



l + {K-l)\h\ 2 



in (18c). This choice guarantees that the achievable rate for user K exactly matches the term 



in ( |15c[ ) in the upper bound. 



Next we would like to match the upper bound term in ( |15b[ ) to the achievable rates in ( |18b| ) 
by setting 



7, =0, je[2,K-l], 



1 _ w 

2 1 + N 2 | 7 id 2 ' 
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However, from the power constraint for user K, we must satisfy 



,2/ i-ItkI 2 



K-2 ' 



which imposes the following condition 

K -A 



K-2 



The above condition cannot be satisfied for > 4; for K = 3 it requires that 



i i 

< 



l + 2|/i ; | 2 " |/*i| 2 + 2 

which can be satisfied by |/ii| 2 > I. Therefore, in the following we shall assume |/ii| 2 > 1 and 
set 7j- = 0, j G [2, K - 1] and 



i/3i 2 = i/3 2 i 2 = ... = i^r = 



l-|7id 2 _ _J_ 

K-2 K-2 ^ x 1+(K 

l+|fej| 2 |73| 2 l+3|/ij| 2 

2 2(l + 2|/l;| 2 ) 



K = 3 



which implies 



«k 





i-m 2 -h K \ 2 = 



2(l+2|fti| 2 



X > 4 
X = 3 



Finally, for j e [2 : K - 1] 

Kf = l-|/3/ = 

The rates then become: for K > 4 
ifc = log (1 + 



K-3 j 1_ 1 

K-2 K-2 l+(K-l)|/i;| 2 

1+N 2 
2(l+2|fti| 2 ) 



K > 4 
K = 3 



|/lc 



i?j = log 1 + I \h d \ - hi 



i (k-i)^! 2 

2 K-2 l+(K-l)|/ii| 2 



1 + 



Ifeil 2 

1+(X-1) N 2 



> log 1 + 



I /id I -/lil A" - 1 

K-2 AT + 1 



/ 



1 + 



Ri = log 

> log I 1 + 



, j e [2 : K - 1], since |/ii| 2 > 1, 

2 \ 



\h A \ + \h i \J(K-3)(K-2) + 1+ ^ )lhil , 



\ 



1 + 



N 2 
i +( K-i)N 2 



i | ||fe d | + |fe i |y/(^-3)(^-2) 

2 



/ 

, since |/ij| 2 > 1, 
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and for K = 3 



Rs = log 1 + 



M 2 



1 + 21/iil 2 



i? 2 = log( l+||/i d |-/ii| - 



/ 



1 + 



I /id | + |/ii| 



i+N 2 

2(l+2|/np) 



-l+|fei| 2 
2(l+2|/l;| 2 ) 



1 



N 2 



l+2|/li| 2 



> i () o ( i + N±JMI ) f S i nc e \ h .f > ] . 



By taking the difference between the upper bound in ( 15) and the derived achievable-rates we 
find that the gap is upper bounded by: for K > 4 



GAP < (if - 2) log(2) + (K - 2) log 1 + 



||/id| - /ii| 



-log 1 + 



1 1 /id | -/li| if - 1 

K-2 K + l 

2 s 



+ log ( i + ( W + (A" - dim )')- io g f i + IN + MEWES 



<(K-2)log(2) + (K-2)log 



(if + !)(#- 2) 



log 



( 2{K -Z){K -2) 
V 



2(^-1) 

< - 2) log (K - 2) + log(2exp(2)), 
(where we used i^log e (l + 1/K) < 1) and for K > 3 

GAP < log(2) + log f 1 + (\h d \ + 21/^^ - log (1 + N±JMI 



<61og(2). 

For |/i;| 2 < 1, we can set {3j = otj = 0, jj = 1 for j e [2 : X] to obtain 



if A" / 

£=1 £=1 ^ 



| /id 



The gap to the upper bound is at most 



GAP <{K-2) log(2) + 2 log(tf - 1) + ^ log ^) • 



which is smaller than the gap previously obtained for |/i;| 2 > 1. 
This proves Th. [6] and implies the direct part of Th. [5] 
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D. Multiplicative Constant Gap Results for the symmetric Gaussian Noise Channel 

In order to provide a complete characterization of the sum-capacity of the symmetric Gaussian 
channel we next consider approximate the sum-capacity to within a multiplicative gap, more 
relevant at low SNR than additive gaps. To this end, note that the rate of user j is upper 
bounded by Cj : = log(l + (\h d \ + (K — j)|/ii|) 2 ), j 6 [1 : K\ which in turn is upper bounded by 
K x C\. Consider an achievability scheme in which all users beamform to user 1: this achieves 
the sum-rate i?i H R K = C\. This is to within a factor K of the upper bound, proving Th. [7] 

E. Numerical optimization of inner and outer bounds for the symmetric 3-user case 

Fig. [4] shows the proposed upper and lower bound for the symmetric channel with K = 3 
users and SNR= 20dB. In this case the upper and lower bounds where optimized numerically so 
as to obtain a larger achievable rate and a tighter outer bound than those used for the analytical 
evaluation of the gap. We notice that the gap between the bounds is much less than the theoretical 
gap of 6 bits. In particular, for strong interference the bounds are extremely close to one another, 
showing again that the theoretical gap of 6 bits is a worst case scenario. Fig. [5] shows the additive 
gap for K = 3 users at SNR= 50dB; notice the gap between the analytical upper and lower 
bounds (curve labeled 'th') converging to 6 bits for large a while the gap between the numerically 
optimized upper and lower bounds (curve labeled 'num') going to zero in the same regime; the 
larger gap is at a = 1 where the channel matrix becomes rank deficient; overall the gap is at 
most of the order of 1 bit, which is about 5 bits smaller than the analytical gap. 

VI. Conclusion 

In this paper we studied the K-user cognitive interference channel with cumulative message 
sharing. A computable, general outer bound valid for any number of users and any memoryless 
channel is obtained. For the linear deterministic approximation of the Gaussian channel at high 
SNR we obtained the sum-capacity for all channel gains in the case of three users, and the 
symmetric sum-capacity for any K. For the Gaussian channel, we provided a unified achievability 
scheme which achieves to within a constant additive and multiplicative gap the sum-capacity 
outer bound. In the linear deterministic channel, the sum-capacity was achieved by a scheme 
which only required cognition at one single user. This begs the question of whether, for the 
Gaussian channel, one may achieve to within a constant gap of capacity by only having one 
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fully cognitive user; our current achievability scheme does require cognition at intermediate 
transmitters for dirty paper coding. Furthermore, comparisons with different K user cognitive 
models are of interest and subject of current investigation. 
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Appendix A 
Proof of Th.Q] 

By Fano's inequality H{W i \Y i N ) < Ne N with -»■ as iV -»■ oo for all % e [1 : 3]. 



The bounds in equation d6ab through (6c) are a simple application of the cut-set bound. 



The bound in (6d) is obtained as follows: 



N(R 2 + R 3 - 2e N ) < I(Y 2 N ; W 2 ) + I(Y 3 N ; W 3 ) 

(b) 

< I(Y 2 N , Wv, W 2 ) + I(Y 3 N , Y 2 N , W 1: W 2 ; W 3 ) 
( = } I(Y 2 N ; WilWj + I(Yf, Y 2 N ; W 3 \W X , W 2 ) 
® I(Y 2 N ; W 2 \W X ) + I{Y 2 N ; W 3 \W U W 2 ) 

+ I(Y 3 N ;W 3 \W U W 2 ,Y 2 N ) 
( = } I(Y 2 N ; W 2 , W 3 \W!) + I(Y 3 N ; W 3 \W U W 2 , Y 2 N ) 
QliY^W^WslWuX?) 

+ I(Y 3 N ; WslWi, W 2 , Y 2 N , Xf , X») 
(g) N 

< J2 H ( Y 2,t\ X i,t) ~ H(Y 2tt \X^X 2tt ,X 3tt ) 
t=i 

+ H(Y 3 j\X l t , X 2tt ) — H(Y 3>t \Xi t t, X 2t t, X 3i t) 

N 

I(Y 2 /, X 2> t, X 3tt \Xij) + I(Y 3i t, X 3 j\Xij, X 2 



N 

(h) 



t), 



t=l 



where (a) follows from Fano's inequality, (b) the non-negativity of mutual information, (c) 
from the independence of the messages, (d) and (e) from chain rule (note how we gave side 
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information so that we could recombine different entropy terms), (f) because the inputs are 
deterministic functions of the messages, (g) follows since conditioning does not reduce entropy, 
and (h) definition of mutual information. 

With similar steps (give enough messages so that we can reconstructs the inputs as also give 
outputs so that we can recombine terms by using the chain rule of mutual information) we obtain 



the bound in (6e). The main steps are: 



N(R! + R2 + R3- 3ejv) 

< /(Y^; Wi) + I(Y 2 N ; W 2 ) + I(Y 3 N ; W 3 ) 

< /(Y^; Wi) + I{Y 2 N , Yf, W x - W 2 ) + I{Y 3 N , Y, N , W u Y 2 N , W 2 ; W 3 ) 

< /(y^; W l7 W 2 , W 3 ) + I(Y 2 N ; W 2 , W 3 \Y? , W x ) + I(Y 3 N ; W 3 \Y? , W x , Y 2 N , W 2 ) 

N 

,t, X 2>t , X 3)t ) + I\Y 2 ,t] X 2 ,t, X 3)t \Xi : t, Yi t t) + I(Y 3 j', Xs t t\Xi t t, X 2jt , Yi,t, Y 2 j). 

t=i 

Appendix B 
Proof of Th.|2] 

By Fano's inequality H{W i \Y i N ) < Ne N with e N -»■ as N -»■ 00 for all i e [1 : K\. 



For ( |7a| ) we have 

N(Ri - e N ) 

< HY t N ; Wi\ 



<I(Y l I ";W l \W u ...,W, 

N 



= ]T /i(y m |Wi, . . . , wi-x, y/- 1 ) - • • • , w it Yt 1 ) 
t=i 

N 

t=i 

iV 

< J2 h (Yi,t\Xi,t, ■ ■ .,Xi- 1)t ) - h{Y i>t \X 1)t , . . .,X Ktt ) 
t=i 

N 

= I(Xi,t] Xi,t, ■ ■ ■ , Xx,t\Xi t t, . . . , Xi-ij). 



t=l 
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For f7b| ) we have 

K 



K 



if 

< y/*, Wi, . . . yJli, Wj-i; Wj 



J ~ l =0 for i = 1 =0 for j = i 

if 

E /!T < V ---- V / V:ir ' ir > ^ ) 

j=i 

K j 

j2J2 Ttv - N ' WAW " Wj 1 yN V - A 

j=i k=i 
K K 



;i(Yj> l ] w j \w 1 ,...,w j -. 1 , y/\...X-i) 

= E E - . , ^--1, *f , - , 

if 

t~ ' v ' ' v ' 

=0 for i = 1 =0 for k = i 

K N 

< I(Yk,t', Xk,ti • • • , -2Gc,t|-Xi,t, • • • j -Xfc-i,t, ii,t) • • • , ife-i.t)- 



fe=! t=l 
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Fig. 1. The Gaussian 3-CIFC-CMS. 
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Fig. 2. LDC 3-CIFC-CMS in weak interference with a — 1/2. The achievable rates are Ri/n = R2/11 — 1, R-i/n = 1 — a 
thereby achieving the sum-capacity upper bound in |8j under the condition in \\0) . 
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Fig. 3. dsipt; K)/K for different channel models. The discontinuity at a = 1 is not shown where the value is j^. 
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Fig. 4. Comparison of the numerically optimized inner and outer bounds for K — 3 users at SNR= 20dB as a function of 
a = i°g9i% d |) ; notice a smaller gap than the worst case predicted 6 bits per channel use per user. 




Fig. 5. Analytical and numerical additive gaps for K — 3 users at SNR= 50dB. 
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